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Abstract 



We report results of a search for the rare radiative decay B'^ — > D*^^. 
Using 9.66 x 10^ BB meson pairs collected with the CLEO detector at the 
Cornell Electron Storage Ring, we set an upper limit on the branching ratio 
for this decay of 5.0 x 10~^ at 90% CL. This provides evidence that anomalous 
enhancement is absent in VF-exchange processes and that weak radiative B 
decays are dominated by the short-distance b ^ mechanism in the Standard 
Model. 



1 



M. Artuso/ R. Ayad/ C. Boulahouache,^ K. Bukin/ E. Dambasuren/ S. Karamov/ 
S. Kopp/ G. Majumder/ G. C. Moneti/ R. Mountain/ S. Schuh/ T. Skwarnicki/ 
S. Stone/ G. Viehhauser/ J.C. Wang/ A. Wolf/ J. Wu/ S. E. Csorna/ I. Danko/ 
K. W. McLean/ Sz. Marka/ Z. Xu/ R. Godang/ K. Kinoshita/'Q I. C. Lai/ S. Schrenk/ 

G. Bonvicini/ D. Cinabro/ L. P. Perera/ G. J. Zhou/ G. Eigen/ E. Lipeles/ 
M. Schmidtler/ A. Shapiro/ W. M. Sun/ A. J. Weinstein/ F. Wiirthwein/'Q D. E. Jaffe/ 
G. Masek/ H. P. Paar/ E. M. Potter/ S. Prell/ V. Sharma/ D. M. Asner/ A. Eppich/ 
T. S. Hill/ D. J. Lange/ R. J. Morrison/ R. A. Briere/ B. H. Behrens/ W. T. Ford/ 

A. Gritsan/ J. Roy/ J. G. Smith/ J. P. Alexander/" R. Baker/° C. Bebek/" 

B. E. Berger/° K. Berkelman/° F. Blanc/° V. Boisvert/° D. G. Cassel/° M. Dickson/o 
P. S. Drell/o K. M. Ecklund/° R. Ehrhch/° A. D. Foland/° P. Gaidarev/o L. Gibbons/° 

B. Gittelman/o S. W. Gray/° D. L. Hartill/° B. K. Heltsley/° P. L Hopman/° 

C. D. Jones/° D. L. Kreinick/° M. Lohner/° A. Magerkurth/° T. O. Meyer/° 

N. B. Mistry/° E. Nordberg/° J. R. Patterson/^ D. Peterson/^ D. Riley/° J. G. Thayer/° 
P. G. Thies/° B. Valant-Spaight/° A. Warburton/o P. Avery/^ C. Prescott/^ 
A. I. Rubiera/^ J. Yelton/^ J. Zheng/^ G. Brandenburg/^ A. Ershov/^ Y. S. Gao/^ 
D. Y.-J. Kim/2 Wilson/2 T. E. Browder/^ Y. Li/^ J. L. Rodriguez/^ H. Yamamoto/^ 
T. Bergfeld/^ B. L Eisenstein/^ J. Ernst/^ G. E. Gladding/^ G. D. Gollin/^ 
R. M. Hans/^ E. Johnson/^ L Karliner/^ M. A. Marsh/^ M. Palmer/^ C. Plager/^ 
C. Sedlack/4 M. Selen/^ J. J. Thaler/^ J. Williams/^ K. W. Edwards/^ R. Janicek/^ 
P. M. Patel/6 A. J. Sadoff/^ R. Ammar/^ A. Bean/^ D. Besson/^ R. Davis/^ N. Kwak/^ 
X. Zhao/8 S. Anderson/9 V. V. Frolov/^ Y. Kubota/^ S. J. Lee/^ R. Mahapatra/^ 

J. J. O'Neill/9 R. Poling/9 j^jg^le/^ A. Smith/^ J. Urheim/^ S. Ahmed/° 
M. S. Alam/° S. B. Athar/° L. Jian/° L. Ling/° A. H. Mahmood/^-Q M. Saleem/° 
S. Timm/o F. Wappler/o A. Anastassov/^ J. E. Duboscq/^ K. K. Gan/^ C. Gwon/^ 
T. Hart/1 K. Honscheid/^ D. Hufnagel/^ H. Kagan/^ R. Kass/^ T. K. Pedlar/^ 
H. Schwarthoff/i J. B. Thayer/^ E. von Toerne/^ M. M. Zoeller/^ S. J. Richichi/^ 
H. Severini/2 P. Skubic/^ A. Undrus/^ S. Chen/^ J. Fast/^ J. W. Hinson/^ J. Lee/^ 
N. Menon/3 D. H. Miller/^ E. L Shibata/^^ L P. J. Shipsey/^^ V. Pavlunin/^ 
D. Cronin-Hennessy/^ Y. Kwon/^-^ A.L. Lyon/^ E. H. Thorndike/^ C. P. Jessop/^ 

H. Marsiske/5 M. L. Perl/^ V. Savinov/^ D. Ugolini/^ X. Zhou/^ T. E. Coan/^ 
V. Fadeyev/6 Y. Maravin/^ L Narsky/^ R. Stroynowski/^ J. Ye/^ and T. Wlodek^^ 

1 Syracuse University, Syracuse, New York 13244 
^Vanderbilt University, Nashville, Tennessee 37235 
^Virginia Polytechnic Institute and State University, Blacksburg, Virginia 24061 



*Permanent address: University of Cincinnati, Cincinnati OH 45221 
fPermanent address: Massachusetts Institute of Technology, Cambridge, MA 02139. 
•^Permanent address: University of Texas - Pan American, Edinburg TX 78539. 
^Permanent address: Yonsei University, Seoul 120-749, Korea. 



2 



Wayne State University, Detroit, Michigan 48202 
^California Institute of Technology, Pasadena, California 91125 
^University of California, San Diego, La Jolla, California 92093 

^University of California, Santa Barbara, California 93106 
^Carnegie Mellon University, Pittsburgh, Pennsylvania 15213 
'^University of Colorado, Boulder, Colorado 80309-0390 
^'^Cornell University, Ithaca, New York 14853 
University of Florida, Gainesville, Florida 32611 
^^Harvard University, Cambridge, Massachusetts 02138 
^^University of Hawaii at Manoa, Honolulu, Hawaii 96822 
^'^ University of Illinois, Urbana- Champaign, Illinois 61801 
^^Carleton University, Ottawa, Ontario, Canada KIS 5B6 

and the Institute of Particle Physics, Canada 
i^McGill University, Montreal, Quebec, Canada H3A 2T8 
and the Institute of Particle Physics, Canada 
^^Ithaca College, Ithaca, New York 14850 
-^^University of Kansas, Lawrence, Kansas 66045 
^^University of Minnesota, Minneapolis, Minnesota 55455 
^°State University of New York at Albany, Albany, New York 12222 
2^0hio State University, Columbus, Ohio 43210 
^^University of Oklahoma, Norman, Oklahoma 73019 
^^Purdue University, West Lafayette, Indiana 47907 
^^University of Rochester, Rochester, New York 14627 
Stanford Linear Accelerator Center, Stanford University, Stanford, California 94309 
Southern Methodist University, Dallas, Texas 75275 



3 



In recent years exclusive and inclusive [Q] 6 ^ 57 transitions were discovered by 
CLEO. These observations confirmed the existence of effective flavor changing neutral current 
processes in the Standard Model (SM) and stirred significant theoretical interest by opening 
new avenues to search for new physical phenomena 0. 

One of the essential ingredients of the inclusive 6 — S7 measurement by CLEO was 
the assumption that flavor annihilation and I^-exchange radiative transitions, represented 
by decays such as 5° -D*°7, are strongly suppressed. If this were not so, these decays 
could represent a serious experimental background to the inclusive photon spectrum used 
to deduce the b —>■ S'j rate. The primary goal of the study presented in this Letter is 
to establish experimentally whether H^-exchange (flavor annihilation) processes are indeed 
strongly suppressed in B decays. 

We search for the decay —>■ D*^'~f (and its charge conjugate state). In the SM frame- 
work this decay proceeds via VT-exchange between b and d quarks (Fig. p. Naively, this 
transition is suppressed by helicity effects and Quantum Chromodynamic (QCD) color cor- 
rections to the weak vertex. Two theoretical mechanisms to overcome this suppression have 
been proposed in the past. One mechanism has to do with the emission of gluons from the 
initial state quark |^ while the other assumes a large qqg (or color octet) component 
in the B meson wave function. Whether either mechanism could significantly enhance the 
rate is debatable 0. Theoretical estimates which take gluon emission into account predict a 
B^ —>■ D*^'~f branching fraction of the order of 10~^ [ihll- Though the numerical estimates of 
the rate for the color octet hypothesis are not yet available, it is expected that the rate could 
be enhanced by a factor of approximately ten which is a typical color suppression factor. 
So far the presence of a possible enhancement in the decay 5° — D*°7 has not been tested 
experimentally. 




FIG. 1. One of lowest order Feynman diagrams for the decay —>■ D*^^ in the Standard 
Model. 

On the other hand, if QCD suppression is present in the decay B^ D*^'~f, eventually we 
would like to measure the strength of this suppression. Theoretical predictions for the studied 
decay have large uncertainties, therefore, a precise knowledge of the branching fraction would 
allow the QCD radiative corrections to be quantified more reliably. Knowledge of these 
corrections becomes increasingly important as theorists suggest new ways to constrain the 
SM parameters using hadronic B decays. This makes the decay B'^ Z}*°7 an interesting 
process to study even if QCD suppression is present. 

The data analyzed in this study were collected at the Cornell Electron Storage Ring 
(CESR) with the CLEO detector. The results are based on 9.66 x 10® BB meson pairs, 
corresponding to an integrated e~^e~ luminosity of 9.2/6~^ collected at the T(4S) energy of 
10.58 GeV. To optimize most of our selection criteria, we also employed 4.6 fb~^ of e~^e~ — > qq 
{q = u,d,s,c) annihilation data ("continuum") collected approximately 60 MeV below the 



4 



T(4S) energy. Our data sample was recorded with two configurations of tfie CLEO detector. 
Tlie first third of the data were recorded with the CLEO II detector which consisted of 
three cylindrical drift chambers placed in an axial solenoidal magnetic field of 1.5T, a CsI(Tl)- 
crystal electromagnetic calorimeter, a time-of-flight plastic scintillator system and a muon 
system (proportional counters embedded at various depths in the steel absorber). Two thirds 
of the data were taken with the CLEO II. V configuration of the detector where the innermost 
drift chamber was replaced by a silicon vertex detector |]lOl and the argon-ethane gas of the 
main drift chamber was changed to a helium-propane mixture. This upgrade led to improved 
resolutions in momentum and specific ionization energy loss (dE/dx). The response of the 
detector is modeled with a GEANT-based |TT| Monte Carlo simulation program. The data 
and simulated samples are processed by the same event reconstruction program. Whenever 
possible the efficiencies are either calibrated or corrected for the difference between simulated 
and actual detector responses using direct measurements from independent data. 

We search for — > Z)*°7 candidates among events where a photon with energy greater 
than 1.5 GeV is accompanied by a fully reconstructed meson. The mesons are recon- 
structed in their decays to D'^ti^ and Z}°7 with the D° mesons decaying to K~tt~^, K^-k^-k^ or 
K'Ti^TT'n^ . These reconstructed channels comprise 25% of the product branching fraction 
for the D*^ and decays. Multiple entries are assigned a weight inversely proportional 
to the number of candidates identified in the event. As we apply selection criteria, the 
reweighting is performed appropriately. The average number of candidates per event before 
and after event selection are 10 and 1.1, respectively. 

Efficient track and photon quality requirements have been designed to minimize system- 
atic uncertainties. This includes selecting only those photons that are detected in the region 
of the calorimeter where the resolutions are well modeled. Kaon candidates are required to 
have measured dE/dx within ±2.5 standard deviations (a) of the expected energy loss. Pairs 
of photons combined to form the 7r° candidates are required to have masses within —3.5(7 and 
-|-2.5cT {a Q MeV/c^) of the 7r° mass [0. To improve mass resolution for parent particles, 
the TT^ candidates are kinematically fit to this mass. To suppress combinatorial background, 
soft photons from the D*^ — > decays are required to have energies above 200 MeV. 
This selection is 50% efficient. The invariant mass of the candidates is required to be 
within ±2.5(T {a ^ 8.0 MeV/c^), ±2.0(t {a ^ 15.0 MeV/c^) and ±1.5a (a ^ 7.5 MeV/c^) 
of the mass of 1.8646 GeV/c^ in final states with one, two and three pions, respec- 
tively. The D*^-D^ mass difference 6M is required to be within ±2. Oct of 142.1 MeV/c^ 
{a ^ 1.0 and 5.0 MeV/c^ for the 7r° and 7 decays of the respectively). To select 

— s> K^Ti^-K^ candidates we require the K~tt^ and tt^tt^ invariant masses to be consistent 
with the resonant substructure of the decays [|12[. Continuum data were used to optimize 
these criteria to suppress combinatorial backgrounds. 

The major sources of background are photons from initial state radiation and from 7r° 
decays both from continuum and BB events. To suppress the real vr^ background and to 
reduce the cross-feed between the tt^ and 7 reconstruction channels of the D*", we apply a 
77*^ veto to the photons from both the D*^ decay and the -B" decay. This is done by rejecting 
photons that, when combined with another photon candidate, form 7r° candidates within 
—4.5(7 and +3.5(7 of the tt*^ mass. To suppress the remaining continuum background, we use 
a Fisher discriminant technique [1^. This discriminant is a linear combination of three angles 
and nine event shape variables. The first angle is between the B'^ candidate momentum and 
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the e^e~ collision ("beam") axis. The second is the angle between the beam axis and the 
direction of the 5° candidate thrust axis. The third is the angle between the thrust axis of 
the -B" candidate and the thrust axis of the rest of the event. The nine event shape variables 
are the amount of energy detected in 10° cones around the direction of the signal photon from 
the 5° decay. The Fisher discriminant coefficients are optimized to maximize the separation 
between continuum events that are jetlike and BB events that are spherical in shape at the 
T(4S) energy. This important selection criterion is optimized for each reconstruction channel 
separately using a combination of continuum data and simulated signal events, and has an 
efficiency between 40% and 70% depending on the reconstruction channel. 

We define the signal region in the two-dimensional plane of the beam-constrained B mass 



M{B) = \JEl^^^ - p{By and the energy difference AE = - Ebeam, where -Ebeam is the 

beam energy, p{B) is the momentum of the B^ candidate and E{B) is its detected energy. 
The signal region is defined by M{B) > 5.275 GeV/c^ and |A^| < 100 MeV. The M{B) 
requirement is 1.5a below the actual 5° mass {a ~ 2.8 MeV/c^). These criteria are 
optimized to suppress the cross-feed from B decays to higher-multiplicity final states. The 
signal region selection is 78% efficient. 

No events are found in the signal region. Projections onto the AE and M{B) variables are 
shown in Fig. 0. On average we expect 0.5 continuum background events in the signal region. 
We estimate this number from continuum data by relaxing the event selection requirements. 
The contribution from the decay B^ D*^t[^ in the signal region is less than 0.9 events 
assuming B{B^ D*^7r^) < 4.4 x 10~^ at 90% CL |T^. The theoretical predictions for this 



branching fraction are of the order of 10 [15,16|. The contribution from all other known B 



decays in the signal region is negligible. Six data events in the AE sideband are consistent 
with Monte Carlo expectations for the cross-feed from the decay B~^ D*^ . This decay 
can produce B'^ D*^'y candidates with AE < — when the 7r° decays asymmetrically 
and is emitted along the direction. 

To derive the upper limit we combine all six reconstruction channels. Efficiencies are 
weighted taking into account the branching fractions for the D*^ and decays. The overall 
reconstruction efficiency is 2.3%, where the major contributions are due to the exclusive 
reconstruction approach (30%), the track and photon quality requirements (65%), the 6M 
requirement (30%) and the Fisher discriminant technique (58%). To estimate the upper 
limit, we conservatively reduce reconstruction efficiency by its systematic error (18%). The 
largest contributions to this error are due to the uncertainties in the track and photon 
reconstruction efficiencies (11%), the branching fractions (9%), Fisher discriminant (6%) 
and the efficiencies of the requirements on the reconstructed masses of the (5%) and B^ 
(5%) candidates. To estimate the upper limit we assume ;B(T(4S) B^B^) = ;B(T(4S) 
B^B^) = 0.5. The upper limit on the number of detected signal events is 2.3 at 90% CL 
and corresponds to an upper limit on the branching fraction for the decay B^ D*^^ of 
5.0 X 10-5 at 90% CL. 

We performed the first search for the decay B^ —>■ D*^'~f and set an upper limit on its 
branching fraction of 5.0 x 10"^ at 90% CL. Our non-observation is consistent with the ab- 
sence of anomalous enhancements that could have overcome short-distance color suppression 
in the studied process. We confirm theoretical predictions that weak radiative B decays are 
dominated by the short- distance b ^ s'j mechanism. Finally, our results should be useful for 
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studies of radiative and color-suppressed processes with heavy quarks at future high statis- 
tics B physics experiments. At these facihties the decay — > D*°7 should be utilized to 
verify if the short- distance QCD radiative corrections are under firm theoretical control and, 
possibly, to search for new physical phenomena. 
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FIG. 2. a) AE and b) M{B) projections of the signal region. Points show the T(4S) 
data, solid and dashed histograms show the predictions of the signal and BB simulations, re- 
spectively. The prediction of the BB simulation is normalized to the statistics of our data sample 
according to the B branching fractions |jl2|. Simulated signal events are shown assuming that 
B{B^ D*^'y) ~ 30 X 10^^. The non-zero simulated BB contribution in the signal region is due to 
the decay B^ D*^tt^ assuming 

5(^0 ^ D*^TT°) = 1.0 X 10"^. Multiple candidates are weighted 

as described in the text. 
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